Improving Automatic Sign Language Recognition through Sign Perceptual Knowledge
نویسندگان
چکیده
Studies in automatic sign language recognition (ASLR) have mainly focused on data-driven methods (see [1]). Little attention has been paid to the perception of sign language and how knowledge from this field can improve ASLR. In part, this is because the field of sign perceptual research itself is quite young, and knowledge is far from complete. However, recent studies ([2]) have yielded results which could significantly improve ASLR. This paper discusses two experiments that demonstrate the advantage of applying perceptual knowledge to a visionbased ASLR-system. Figure 1 illustrates the applications.
منابع مشابه
Sign language perception research for improving automatic sign language recognition
Current automatic sign language recognition (ASLR) seldom uses perceptual knowledge about the recognition of sign language. Using such knowledge can improve ASLR because it can give an indication which elements or phases of a sign are important for its meaning. Also, the current generation of data-driven ASLR methods has shortcomings which may not be solvable without the use of knowledge on hum...
متن کاملThe Eye of the Beholder Automatic recognition of Dutch sign language
Preface For as long as I can remember, I have been interested in languages. Sign languages especially fascinate me, because they are natural languages using a different modality: sign languages use images as the vehicle for information. This has strange implications: in sign language, it is easy to have a conversation with someone at the other side of a crowded room. On the other hand, it is im...
متن کاملMAN-MACHINE INTERACTION SYSTEM FOR SUBJECT INDEPENDENT SIGN LANGUAGE RECOGNITION USING FUZZY HIDDEN MARKOV MODEL
Sign language recognition has spawned more and more interest in human–computer interaction society. The major challenge that SLR recognition faces now is developing methods that will scale well with increasing vocabulary size with a limited set of training data for the signer independent application. The automatic SLR based on hidden Markov models (HMMs) is very sensitive to gesture's shape inf...
متن کاملImproving Continuous Sign Language Recognition: Speech Recognition Techniques and System Design
Automatic sign language recognition (ASLR) is a special case of automatic speech recognition (ASR) and computer vision (CV) and is currently evolving from using artificial labgenerated data to using ’real-life’ data. Although ASLR still struggles with feature extraction, it can benefit from techniques developed for ASR. We present a large-vocabulary ASLR system that is able to recognize sentenc...
متن کاملMethods for Human Motion Analysis for American Sign Language Recognition and Assistive Environments
METHODS FOR HUMAN MOTION ANALYSIS FOR AMERICAN SIGN LANGUAGE RECOGNITION AND ASSISTIVE ENVIRONMENTS ZHONG ZHANG, Ph.D. The University of Texas at Arlington, 2015 Supervising Professor: Vassilis Athitsos The broad application domain of the work presented in this thesis is human motion analysis with a focus on hand detection for American Sign Language recognition and fall detection for assistive ...
متن کامل